Thermodynamic derivation of the mutual information for discrete symmetric channels
نویسندگان
چکیده
Abstract The mutual information for the binary symmetric channel as well as for the discrete symmetric channel consisting of 4-input/output (I/O) symbols is explicitly calculated using the generalized second law of thermodynamics which was recently proposed by the first two authors. For equiprobable I/O the mutual information of the examined channels has a very simple thermodynamic form as a function of the internal energy of the channel. We prove that this simple form of the mutual information governs the class of discrete memoryless symmetric communication channels with equiprobable I/O symbols.
منابع مشابه
Carnot in the Information Age: Discrete Symmetric Channels
Modeling communication channels as thermal systems results in Hamiltonians which are an explicit function of the temperature. The first two authors have recently generalized the second thermodynamic law to encompass systems with temperature-dependent energy levels, dQ = TdS+ < dE/dT > dT , where < · > denotes averaging over the Boltzmann distribution, recomputing the mutual information and othe...
متن کاملOn the Distribution of Mutual Information
In the early years of information theory, mutual information was defined as a random variable, and error probability bounds for communication systems were obtained in terms of its probability distribution. We advocate a return to this perspective for a renewed look at information theory for general channel models and finite coding blocklengths. For capacityachieving inputs, we characterize the ...
متن کاملA New Unequal Error Protection Technique Based on the Mutual Information of the MPEG-4 Video Frames over Wireless Networks
The performance of video transmission over wireless channels is limited by the channel noise. Thus many error resilience tools have been incorporated into the MPEG-4 video compression method. In addition to these tools, the unequal error protection (UEP) technique has been proposed to protect the different parts in an MPEG-4 video packet with different channel coding rates based on the rate...
متن کاملAchievable rate of MIMO channels with data-aided channel estimation and perfect interleaving
The achievable rate of a coherent coded modulation (CM) digital communication system with dataaided channel estimation and a discrete, equiprobable symbol alphabet is derived under the assumption that the system operates on a flat fading MIMO channel and uses an interleaver to combat the bursty nature of the channel. It is shown that linear minimum mean square error (LMMSE) channel estimation d...
متن کاملThe effect of discrete lateral and torsional bracings stiffness on the elastic lateral-torsional buckling of mono-symmetric I beam, under the concentrated moment
When the out-of-plane stiffness of a beam is remarkably lower than the in-plane stiffness, the lateral-torsional buckling occurs. In this study, the behavior of mono-symmetric I-beams with discrete torsional and lateral bracings under the concentrated moment is investigated using the finite element analyses. Then, based on the numerical analyses, equation for the stiffness requirement is propos...
متن کامل